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Spring 3.0 fully embraces Java 5, 
says SpringSource's Sampaleanu. 

Spring 3.0 
eases Java 
configuration 

BY ALEX HANDY 

A new expression language and a 
focus on simplifying configura- 
tion mark the version 3.0 release 
of the Spring Framework, due to 
be available in mid-October. 

Configuration has always 
been a major headache for Java 
developers, and the Spring 
Framework has always focused 
on refining the configuration 
process for enterprise Java. Colin 
Sampaleanu, director of techni- 
cal sales at SpringSource, said 
that a number of the changes in 
Spring 3.0 help ease the process. 

"XML configuration syntax 
has gotten simpler in every 
release of Spring," said Sam- 
paleanu. "Until now, Spring sup- 
ported XML configuration, 
continued on page 21 ► 



Open Mashup Alliance 
seeks universal language 



BY JEFF FEINMAN 

The world of mashups is a wide 
one with data coming from a 
seemingly infinite number of 
places, but the Open Mashup 
Alliance is looking to bring some 
order to all that complexity. 

The Open Mashup Alliance, 
announced in September, will try 
to have a formal body standard- 
ize the Enterprise Mashup 
Markup Language (EM ML). 

EMML, which JackBe con- 
tributed to the public under the 
Creative Commons License, is 
an XML language. John Crupi, 
CTO of JackBe, called EMML a 



data-centric language that uses 
XPath and XQuery to filter and 
query data. It is a declarative 
language that has the ability to 
invoke heterogeneous services, 
including Java, REST, RSS and 
WSDL services. 

"The goal of the alliance is to 
get the enterprise mashup mar- 
ket to move faster in driving 
adoption and interoperability 
around the language, and to be 
able to show the industry that 
this is a serious technology for 
the enterprise," Crupi said. "The 
real effort here is to really foster 
and steward the language to the 



point where the alliance eventu- 
ally contributes it to a formal 
standards body, such as W3C 
[World Wide Web Consortium] 
or OASIS." 

The alliance currently has 11 
members. Those companies are 
Adobe, Bank of America, tech- 
nology consulting firm Capgemi- 
ni, Hewlett-Packard, consulting 
firm Hinchcliffe & Co., Intel, 
JackBe, mashup maker Kapow, 
ProgrammableWeb, financial 
consulting firm Synteractive, and 
financial market data company 
Xignite. 

continued on page 21 ► 




CROWDSOURCING 
GETS NEW SERVICES 

page 13 



FlightCaster foretells future of development 




The FlightCaster team built the predictive system for flight delays in about 
four months; so far, it has an 85% success rate predicting long delays. 



BY ALEX HANDY 

We've all been stuck in an airport 
during a major flight delay. In 
August, a startup called Flight- 
Caster launched a Hadoop-based 
predictive A.I. system that can 
tell you when your flight will be 
delayed before it happens. That's 
interesting enough on its own, 
but the story of how FlightCaster 
was built feels like a glimpse into 
the future of software develop- 
ment, not just the future of air 
travel. 

Bradford Cross was one of a 
handful of engineers brought in 
by the company's five founders to 
build FlightCaster. The team 
originally began work in May, but 
crunched in earnest on the pro- 



ject during the third quarter. The 
resulting service, which has been 
publicly available since late 
August, has correctly predicted 
delays of over 60 minutes almost 
85% of the time. 

Cross and the other engineers 
on the FlightCaster team don't 
even have job titles, but Cross' 
duties focused on research and 
the construction of the support- 
ing infrastructure. He said that 
this project was quite different 
for him in many ways. 

"It's like we're using domain 
understanding and intelligent 
systems techniques to build a 
better model of how operations 
work in the airline industry," said 
continued on page 21 ► 
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Smarter technology for a Smarter Planet: 
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By next year, the average car will require over 100 million lines 
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It's no wonder then that fully 66% of the products developed in the 
past year included some kind of embedded software. 

Today, every company needs to consider software a core strategic 
business asset. Unfortunately, 41 % of software projects fail to 
deliver the expected business value and ROI. Only IBM has the 
experience, the resources and the solutions to build more effective 
software design and delivery processes for the world's leading 
businesses. So they can foster collaboration, automate workflows, 
report progress against goals and improve on results. 

A smarter business needs smarter software, systems and services. 
Let's build a smarter planet, ibm.com/delivery 



\ I / 



© 



in 

lu- 
ll 

llll 



I 




IBM, the IBM logo, ibm.com, Smarter Planet and the planet icon are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names 
might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at www.ibm.com/legal/copytrade.shtml. © International Business Machines Corporation 2009. 



NEWS 



Software Development Times . October 15, 2009 , 



www.sdtimes.com 



NEWSlflfflEFS 



, COMPANIES , 



German security companies charismathics gmbh and Wibu-Systems 

have entered a product agreement so that Wibu's CodeMeter software 
licensing suite will integrate with identity management standards with 
the help of charismathics' security interface. CodeMeter will also bet- 
ter integrate with applications such as Acrobat, Firefox and Outlook 
. . . Microsoft and France-based Web technology consulting firm Noe- 
lios Technologies have released a new version of the Restlet open- 
source project, a REST framework for Java that includes the Restlet 
Extension for ADO.NET Data Services. Microsoft executives said the 
extension makes it easier for Java developers to utilize ADO.NET Data 
Services and connect their applications to the .NET platform . . . Host- 
ed software-licensing company Nalpeiron has created www.software- 
licensing.tv, a website for news about software piracy and software 
copy protection. The site will include a section called ISV Viewpoints, 
which will have podcasts and videos on licensing, along with articles 
from software developers . . . Security company WhiteHat Security 
has created the WhiteHat Security Support Plus program for users of 
the company's Sentinel Web application security software. The pro- 
gram has plans for different company budgets, including the Standard 
plan with 24-hour access to a Web support portal and next-business- 
day response time; the Silver plan, which has response times in eight 
business hours and guarterly service reviews; and the Gold plan, which 
has one- to four-hour response times and monthly service reviews. 



NEW PRODUCTS 



Data management company Jigsaw has released a suite of APIs and 
a toolkit that allow developers to deliver company profiles and contact 
data from inside their Web, desktop or mobile applications. The com- 
pany also launched a new program so that companies can let their cus- 
tomers use Jigsaw accounts to acquire contact data or resell Jigsaw 
data . . . Embedded software company Green Hills Software has rolled 
out INTEGRITY Secure Virtualization as part of its new Embedded 
Virtualization business unit. INTEGRITY Secure Virtualization hosts 
Linux, VxWorks, Windows and other operating systems in virtual con- 
tainers on ARM, Intel, Power and other processor architectures. 



UPDATES 



Vi Laboratories has added new reporting capabilities to its CodeArmor 
Intelligence 2.0 application piracy detector. Piracy notifications can 
focus on specific machines or geographic regions based on rules con- 
figured on the gateway server. CodeArmor Intelligence can now also 
configure local encrypted log files, allowing infringement data to be 
logged locally when the computer is not connected to the Internet . . . 
Project and portfolio management company Projecturf has added a 
new bug tracking system to Projecturf 2.0, its project collaboration 
software. The new system contains ticketing numbers and a ticket log 
to monitor bugs, and there is also a section where developers can 
store code snippets . . . IBM has created a new systems engineering 
toolkit in Rational Rhapsody 7.5, its model-driven development plat- 
form. IBM said the toolkit provides functions like migrating data 
between engineering levels, and automatic population of diagrams . . . 
Mobile development company Netbiscuits now allows browser-based 
mobile websites to be embedded into downloadable client apps, called 
"Shell Apps," for Android, iPhone, Symbian and Windows Mobile. The 
websites are embedded into a shell application that can utilize other 
functions, like the ability to save content or access native cell phone 
applications . . . Test and QA company uTest has released version 2.6 
of its testing platform, which offers a new tester profile where testers 
can specify their operating system and mobile device, along with any 
coding languages and testing software they have experience using. 



PEOPLE 



George Shanks has been named new CEO of engineering design opti- 
mization software provider dezineforce. Shanks was most recently 
CEO of communications services company JacobsRimell. In 1998, he 
cofounded Rubus, an Internet consultancy. I 



Holiday Inn stops waterfall 
for technology rebranding 



BY ALEX HANDY 

In 1965, Holiday Inn became 
the first hotel chain in the world 
to utilize a central reservation 
system. The computerized reser- 
vation system at the heart of the 
hotel chain became a symbol of 
the company's technological 
vision, but 44 years later, that 
same reservation system remains 
at the heart of the company 

Steve Sullivan, manager of 
Web reservations, revenue and 
guest technology at Interconti- 
nental Hotels Group, which 
owns Holiday Inn, has been 
wrapping Web interfaces around 
that reservation system for seven 
years now When he joined the 
company, his team was small and 
located on the same floor Today, 
the team has spread out across 
the building and even includes 
outsourced members in India. 

Last fall, Holiday Inn began 
a major rebranding, and Sulli- 
van's team had to rework the 
company's Web presence. The 
project called for the addition 
of local information so that 
guests could find restaurants 
and events in the area around 
each hotel. That meant Sulli- 
van's team had to integrate a 
new database of knowledge into 
the site, while also handling 
new art on almost every page. 

Sullivan's team has hovered 
around 10 people, which he said 
is the most effective size. He also 
has a team of around 15 in India 
available to crunch when the 
chips are down. He said he 
favors open-source tooling, and 
his team works primarily in 
Eclipse, Google Web Toolkit and 
IntelliJ IDEA. But it's not the 
stack or the tools are most chal- 
lenging for Sullivan's team. 

MOVING ON TO AGILE 

Sullivan said that the big chal- 
lenge for his team now is shift- 
ing from waterfall to agile. He 
has begun looking into Scrum 
and other agile practices to help 
the team better meet its tight 
deadlines on the project. 

"We decided that we were 
going to chunk this down into 
small pieces and plan out our 
sprints. We wanted to follow 
Scrum, but we couldn't do 
100% Scrum because the busi- 
ness side had been working for 
a while on documents in a 




Intercontinental Hotel Group's 
Steve Sullivan uses mostly internal 
development for his latest project. 

waterfall," said Sullivan. 

"We did borrow tactics from 
Scrum, like planning sessions. 
For our first sprint, we decided 
to go through and be able to 
make a reservation and show 
results. Our first goal was that 
you get a reservation number." 

Since that project began, 
Sullivan has been experiment- 
ing with agile elsewhere. 

"We being in waterfall really 
hindered us; we're in this 'Are 
you done yet?' sort of state. We 
started working more collabora- 
tively with the business people," 
he said. "We all went together 
and had Scrum training a couple 
of weeks ago... But being realis- 
tic, I know it's not something that 
can happen overnight." 

One of the problems Sulli- 
van's team faced was the water- 
fall nature of requirements com- 
ing from the business side. 
Before the Scrum training, Sulli- 
van said his team would wait for 
requests from business. 

When those requests arrived, 
they were typically long and 
complex, but though they'd been 
in development on the business 
side for some time, the develop- 
ers could only begin their work 
when the full-blown requests 
arrived. Sullivan hopes the 
Scrum training received by his 
team and the business folks will 
to make the process more agile. 

"One of the keys to our suc- 
cess was having a strong prod- 
uct owner," said Sullivan. "One 
of the problems we ran into 
early on was that we would have 
a product owner, but they were 
a [businessperson] by trade, 



and they wouldn't make deci- 
sions fast enough. We had a war 
room for this project, and once 
we got the right person in the 
room who would make deci- 
sions, things were better." 

The war room, said Sullivan, 
puts the developers in the same 
room, allowing them to com- 
municate with one another. The 
product owner, sitting in that 
room, could quickly make deci- 
sions without calling a meeting 
with stakeholders. The product 
owner could say, "Yes, use that 
drop box," and be done with it, 
increasing the team's velocity. 

OUTSIDE HELP 

Sullivan's team still has to meet 
tight rebranding deadlines, but 
he said the agile processes he's 
brought to the team are helping 
to speed progress. He also said 
his team is bidding to build an 
iPhone application for the sys- 
tem, something he hopes to do 
internally rather than externally. 

Sullivan does use external 
developers, however. Intercon- 
tinental employs an outsourced 
software development firm in 
India, and Sullivan said that 
those extra coders help to scale 
his development processes 
when time is tight. 

Sullivan said two employees 
of the outsourcing firm were 
located on-site during planning, 
and that they have since 
become the leaders of the out- 
sourcing efforts. He added that 
he'd prefer to work with a firm 
in a more compatible time 
zone; one of Sullivan's team 
members was attending both 8 
a.m. and midnight meetings 
with the team in India. 

Sullivan said that the ancient 
reservation system at Holiday 
Inn is destined for the scrap 
heap. He said that the team is 
just beginning work on a 
replacement, but the existing 
interfaces are working for now. 
But that brings up a rare thought 
in software engineering, one of 
historical import. 

"[The reservation system] 
was pretty early on and pretty 
historic at the time," said Sulli- 
van. One must wonder if ripping 
out such an old piece of software 
is similar in concept to removing 
the original wallpaper or flooring 
from a historic house. I 
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A single language for 'Web 2.0' apps 

IBM releases free EGL tool that compiles both front-end and back-end code 



BY DAVID RUBINSTEIN 

To make the development of 
end-to-end Web 2.0 applica- 
tions easier, IBM has released 
its EGL language tool as a free 
community edition. 

EGL, or Enterprise Gener- 
ation Language, is a higher- 



level programming language 
than Java or JavaScript. Devel- 
opers using the Eclipse-based 
tool can write, test and debug 
their application in EGL, and 
the tool compiles the code into 
either JavaScript, for the appli- 
cation's front end, or Java for 



the back end, according to Will 
Smythe, product line manager 
for IBM Rational Business 
Developer (RBD) and EGL. 

RBD is the company's flag- 
ship EGL environment for 
modernizing legacy COBOL 
applications; EGL CE is a sub- 



set of the RBD functionality. 

"JavaScript development is 
difficult. HTML is difficult. 
They are powerful languages, 
but not necessarily designed to 
build the applications people 
are building today," Smythe 
said. EGL CE "shields devel- 



MuleSource iBeans does task-based integrations 



BY DAVID WORTHINGTON 

MuleSource has introduced an 
integration technology called 
iBeans that it says will help Web 
application developers do task- 
based integrations for projects 
where top-down enterprise 
architecture is not required. 

iBeans (short for integration 
beans) is a container that runs 
inside of Apache Tomcat, Teat 
Server and the Mule enterprise 
service bus (ESB), said Ross 
Mason, founder and CTO of 
MuleSource. iBeans was for- 
mally introduced in September. 

It also works with open- 
source frameworks, including 
JavaServer Faces, Spring and 
Struts, but is not limited to sup- 
porting just Java. Groovy, JRuby 
and Scala may be used as well. 

"It's a simple annotations- 



Wcb Application 




MuleSource wants iBeans to be the communications foundation for the 
JVM, says CTO Ross Mason. 



based API that describes how 
to talk to the service instead of 
doing the talking itself. There is 
no message routing," Mason 
explained. "Newcomers use us 
for simpler integrations and 
end up tripping themselves up 
using ESB. It is not the tool for 



the job they are trying to do." 

If developers start out using 
iBeans, and then decide to 
build out a complete architec- 
ture using an ESB, there is an 
upgrade path, Mason said. 
"Everything you have done so 
far will work with Mule. The 



Mule ESB is an iBeans con- 
tainer." 

iBeans containers connect 
Web applications with other 
applications and external data 
sources via Web Services, RSS 
feeds, RESTful services, AJAX 
events and message queues. 
MuleSource has already creat- 
ed iBeans for Amazon EC2, 
eBay, Facebook, Flickr, Gmail 
and Twitter. 

MuleSource has licensed the 
technology under the open- 
source Common Public Attri- 
bution License. "We are hoping 
that people submit back to the 
community, and that they pick 
up the less obvious ones," 
Mason said. 

iBeans is hosted on a com- 
munity website called iBeans 
Central. I 



Adobe streamlines Flash app distros 
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BY JEFF FEINMAN 

Adobe has released a new 
service for the Flash plat- 
form to help developers 
get their applications into 
the hands of hungry con- 
tent consumers. 

With the Flash platform 
service for distribution, 
released in September, a 
user will see a button on 
the application that will 
bring down a "share menu" 
listing approximately 70 
websites, including Face- 
book, iGoogle, MySpace, 
Twitter and Yahoo. The 
user selects where he or 
she wants to send the 
application, and the appli- 
cation can be embedded 
into that website. The The Manage view in the Flash platform service for distribution allows developers to 
Flash platform service for manage all their applications and send them to outside websites. 
distribution is free and can 

quickly, even if they have rela- 
tively low monetization," said 
Adrian Ludwig, group manager 
for the Flash platform. 

Adobe said the new services 
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send content to mobile devices 
or desktop computers. 

"This can allow developers 
to get distribution of their 
application and large reach 



help application developers get 
their content noticed and get 
more people to use it. Puneet 
Goel, Adobe's product market- 
ing manager for Flash platform 



services, said connecting 
applications to social net- 
works and making content 
shareable can be difficult 
to do. 

"There have been sever- 
al providers who provide 
the ability to share your 
applications with MySpace, 
Facebook and other net- 
works, but what hasn't exist- 
ed up until now is the 
native support within our 
toolkit," Goel said. "You can 
add the sharing capability 
much more easily. Beyond 
that, if you were just relying 
on viral distribution, you 
weren't assured of success." 
To try and make appli- 
cation distribution more 
successful, there is also a 
for-pay promotional ser- 
vice that helps developers 
reach out to the places where 
they want to put content. Goel 
said developers are charged 
US$1 per install only for suc- 
cessful installs. I 



opers from the complexity of 
things like managing database 
connections." 

EGL AND JAVA GO TOGETHER 

EGL code, Smythe explained, 
has many of the same concepts 
(such as packages) as Java, and a 
lot of the syntax is similar, so the 
learning curve for Java develop- 
ers to write code in EGL is rel- 
atively low. "EGL is more 
declarative. You declare a 
record, you get a record. Then 
you can populate it or do some- 
thing with it," he said. 

The ability of EGL CE to 
compile into Java and 
JavaScript means that develop- 
ers won't need to spend time 
mapping between languages. 
"You represent a record one 
way in Java and another way in 
JavaScript, and that has to be 
reconciled," Smythe said. 

With EGL CE, he said, 
developers can write a service 
or some UI code, or define 
widgets and set up event han- 
dlers, and preview it all with- 
out having to deploy anything 
to a server. "The tool can inter- 
pret it on the fly," he pointed 
out. 

The EGL CE tool includes 
Dojo widgets; Dojo is a 
DHTML toolkit written in 
JavaScript for the creation of 
dynamic Web pages. "Devel- 
opers can use the widgets with- 
out having to learn Dojo," 
Smythe said. "They appear as 
any other widget in the appli- 
cation." 

Smythe said EGL has been 
around IBM for about five 
years, first as part of IBM 
Rational Application Develop- 
er and then in WebSphere 
Application Developer. It was 
later put into its own product. 

Prior to RBD, IBM had 
VisualAge Generator, a rapid 
application development envi- 
ronment that was to be with- 
drawn from marketing on 
Sept. 30. Its users are being 
migrated to RBD. 

Classic 4GL is the language 
from which EGL evolved, and 
as such represents an opportu- 
nity with RBD for organiza- 
tions to modernize their legacy 
COBOL applications for the 
Web. "But we want people to 
know [EGL] is not just a main- 
frame or iSeries language," 
Smythe said. I 
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Zend API brings cloud application service portability 



BY DAVID WORTHINGTON 

Zend Technologies has an- 
nounced the formation of an 
open-source project called Sim- 
ple API for Cloud Application 
Services that will allow develop- 



ers to use common PHP applica- 
tions' services in the cloud. 

The projects primary goal, 
announced in September, is to 
make it easier for developers to 
write applications that can take 



advantage of the clouds high 
availability and scalability while 
also having portability, said Zend 
cloud strategist Wil Sinclair. 

GoGrid, IBM, Microsoft, 
Nirvanix, Rackspace and Zend 



are cofounders of the project, 
and they will contribute adapters 
for their platforms' application 
services. The first Simple API 
deliverables will be available for 
document databases, file storage 
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and simple queue services. 

Amazon is relying on com- 
munity support to build and 
maintain its adapters for its ser- 
vices, said Sinclair. 

Kristof Kloeckner, CTO of 
IBM Cloud Computing, 
promised that the company will 
contribute adapters for future 
cloud service interfaces and data 
storage products. "The Simple 
Cloud API will enable develop- 
ers to invoke cloud services in a 
common way across cloud 
providers. This can significantly 
reduce the costs for application 
development and provide cus- 
tomer choice," he said. 

Microsoft is contributing its 
client libraries for Windows 
Azure as well as an adapter 
from the Simple cloud API to 
its client libraries. 

The adapters will need to be 
updated when platforms 
change, Sinclair said. "I hope 
they understand the importance 
of backward compatibility." 

Aside from industry contri- 
butions, the Simple API source 
code is available to the PHP 
community to work toward the 
final API, said Sinclair. He 
expects that the API will be 
available for production later 
this year. 

While Simple API can help 
translate common functionality 
across application services, it 
does not establish a standard 
service interface. 

"We don't want to stifle inno- 
vation for vendor value-add fea- 
tures," said Sinclair. "Develop- 
ers can use the [Simple] cloud 
API for 80% of use cases, and 
then use the client library in the 
Zend framework to access ven- 
dor value-add features." 

The API is a "nice idea," but 
"it would be better for the indus- 
try if vendors agreed to support 
[the] same service interface 
instead of supporting adapters," 
said Anne Thomas Manes, vice 
president and research director 
for Burton Group Application 
Platform Strategies. "Then we 
wouldn't need adapters." 

She added that it might be 
too much to ask for competitors 
to agree to use the same inter- 
face. 

"We found surprising indus- 
try interest — more interest than 
we could accommodate for this 
press release. Having Microsoft 
and IBM contribute to the 
effort validates the idea," said 
Sinclair. I 
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Cloudera Desktop manages Hadoop clusters 



BY JEFF FEINMAN 

Apache Hadoop service pro- 
vider Cloudera has launched a 
commercial graphical user inter- 
face for managing Hadoop data 
clusters. 



Cloudera Desktop, expected 
to be released in beta at the 
Hadoop World Conference in 
New York City in early October, 
makes Hadoop easier to use and 
manage, according to Cloudera 



executives. Developers can cre- 
ate and submit jobs, monitor 
cluster health, and browse the 
data stored on a Hadoop cluster 
using Cloudera Desktop. 

"There's currently a bunch 



of command-line tools for peo- 
ple to use when interacting with 
Hadoop clusters," said Jeff 
Hammerbacher, vice president 
of products at Cloudera. "Those 
tools will continue to work if 




you're using Cloudera Desktop. 
We're not taking anything away 
from people." 

The initial release of the 
platform comes with four appli- 
cations: a file browser for copy- 
ing and browsing the data files 
stored on a cluster; a job sub- 
mitter for running and saving 
jobs for reuse or customization; 
a job browser for keeping track 
of job statuses and progress; 
and a cluster health dashboard 
for monitoring a Hadoop clus- 
ter. 

Apache Hadoop is an open- 
source Java framework that 
enables applications to work 
with thousands of nodes of data. 
It was created by Doug Cutting, 
who is currently an engineer 
with Cloudera. Hadoop runs 
applications on large clusters of 
hardware, and it divides applica- 
tions into small fragments of 
work that can be executed on 
any node in the cluster. 

"We thought about what the 
right user interface would look 
like for interacting with 
Hadoop, and we settled on the 
Web browser first," Hammer- 
bacher said. "If you're in a large 
organization, it's pretty difficult 
to keep the client all up to date 
with new upgrades, and 
Hadoop is evolving rapidly." I 



COMMUNITY 
SUPPORT BASIS 
FOR FUNDING 



Before venture capital firm 
Accel Partners first invested 
US$5 million in Cloudera this 
past March, firm partner Ping Li 
spent a lot of time investigating 
the big data problem. To that 
end, he visited another Accel 
Partners company: Facebook. 

Li said that he spent a lot of 
time at Facebook looking at 
what could be done with the 
massive amounts of interper- 
sonal information within the 
social network. "What they real- 
ly spent a lot of time innovating 
around was how do we make 
the database scale, and how do 
we crunch these petabytes of 
transactional data. They ended 
up choosing Hadoop, and that's 
how I got a first-hand experi- 
ence with it," he said. 

As the only company built 
around Hadoop at the time, Li 
said Cloudera was a perfect 
choice for investment. 

"Hadoop has gotten deep 
mindshare with its core com- 
munity of users. I think that's 
the opportunity," he said. 

—Alex Handy 
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to questions such as: 'Who wrote this code, and when?' and 'What content 
got changed, and why?' 

Time-lapse View features a graphical timeline that visually recreates the 
evolution of a file, change by change, tn one fluid display. Color gradations 
mark the aging of file contents, and the display's timeline can be configured 
to show changes by revision number, dote, or changeset number. 

Time-lapse View is just one of the many productivity took that come with the 
Perforce SGM System. 
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New services, APIs are drawing a crowd 

'Crowdsourcing' is gaining popularity in businesses, including software shops 



BY ALEX HANDY 

It's an alluring premise: buzz- 
word-turned-reality "crowd- 
sourcing" is the act of passing 
busywork onto a nebulous cloud 
of humanity. In large part, the 
crowdsourcing movement has 
been held up by the lack of 
business tasks suitable to prac- 
tice, but as the Web expands 
and crowdsourcing companies 
produce APIs, these barriers are 
starting to disintegrate. 

A December 2008 report 
from Gil Yehuda and Chris 
Townsend of Forrester Research 
suggest that it is time for busi- 
nesses to consider crowdsourc- 
ing in future plans. The report, 
entitled "Enterprise Innovation 
Needs a Game Plan," suggests 
that businesses can use the Web 
to harvest new ideas like a 
bumper crop of distributed 
brainstorming. 

While companies like Dell 
and Starbucks use crowds for 
feedback, Netflix used crowds 
to design a better recommenda- 
tion algorithm for its users. 
There, crowds contributed 



code to offer up movies users 
might like based on their previ- 
ous picks. In mid-September, 
the company awarded a cash 
prize of US$1 million to a group 
of scientists and engineers, and 
claimed it had gained more 
than $10 million in what it 
learned from the effort to 
find the algorithm. Netflix 
gained a critical new busi- 
ness feature that required 
little software engineering 
on its part. 

Others companies have 
already staked a tangible 
business claim in crowd- 
sourcing. InnoCentive, Top- 
Coder and others use the 
crowdsourcing approach for 
software engineering. 

A company called LiveOps 
Inc. offers distributed call cen- 
ters built from crowds of peo- 
ple in their own homes. Soft- 
ware Q/A startup uTest offers 
similar services around testing 
software: testers on demand, as 
it were. 

Those services are maturing 
along with the businesses that 



require them. To realize the 
futuristic dream of integrating a 
mass of unaffiliated work-from- 
home temps into any project at 
any time, crowdsourcing ser- 
vices will require some pretty 




Using crowdsourcing, 

and a $1 million reward, 

Netflix was able to 

improve a critical 

business feature. 

robust APIs, and managers will 
have to rethink how work is dis- 
tributed to employees. 

Eckart Walther, senior vice 
president of Marketplace at 
LiveOps, said that there are 
companies that have already 
figured out where crowdsourc- 
ing can help them. 

"When Pizza Hut gets busy, 



Tr 



we have over 20,000 indepen- 
dent contractors," he said. "They 
bid for these phone calls, people 
answer the phone, take the 
order, type it in and things are 
done. When Katrina hit, the 
Red Cross used us to set 
up a call center. They set 
up a center in three hours 
for 300 persons." 

Walther said that 
LiveOps introduced its first 
APIs in September, and 
that they were the first step 
on a road to enterprise- 
ready programmably 
accessible crowds. For 
now, however, tasks already 
in the system can be moni- 
tored remotely, allowing 
LiveOps tasks to be moni- 
tored from remote workflow 
management solutions. 

Lukas Biewald, CEO of 
CrowdFlower, said that repeti- 
tive tasks are actually better 
performed by crowds than by 
small pools of full-time work- 
ers. CrowdFlower provides 
refined instruction and task- 
creation interfaces for services 



like Amazon Mechanical Turk 
and LiveOps' new work distrib- 
ution system, Live Work. 

LiveWork allows specific 
tasks to be farmed to crowds. 
Typically, these tasks are along 
the lines of "read these com- 
ments to detect spam" or "pick 
the photo that is red." But in 
the future, there's no reason 
those tasks can't turn into 
"process this expense report" or 
"balance our budget." 

"The surprising thing is 
workers like this model better," 
said Biewald. "When you can go 
in and start working two min- 
utes later, workers like this. Call 
centers will change their call 
scripts to keep people engaged 
and interested. This is similar. 
It's keeping your brain from 
going crazy with these repeti- 
tive tasks. 

"Social networks hire people 
to sit there all day and label 
things as porn or not. Can you 
imagine if that were your job? 
That would be horrifying. But 
imagine doing that for five min- 
utes? That's fun!" I 
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ThoughtWorks builds up Cruise and Twist 

Manual testing, increased scalability the focus of latest update 



BY JEFF FEINMAN 

Agile development company 
ThoughtWorks Studios has put 
the emphasis on versatility and 
scalability in new versions of its 



Twist test manager and Cruise 
release manager. 

ThoughtWorks Studios' 
Twist now can handle both 
manual and automated testing. 



Company executives said this 
eliminates the need for multi- 
ple testing tools, which can 
lead to more errors. Prior to 
this, Twist only allowed for 



automated testing. 

"You can automate testing 
steps, or you can run it manual- 
ly," said Chad Wathington, vice 
president of product develop- 




ment development for Thought- 
Works Studios. "You can even 
do the automation and still 
decide to run it manually at 
some point. We generate 
HTML reports based off your 
manual test run that is similar 
to the automated report, but it 
has more comments and more 
rich information." 

The new version, released in 
September, has also updated its 
Twist Selenium Recorder to 
record test assertions. The Twist 
Selenium Recorder records 
automated testing scripts and 
allows users to check if a specif- 
ic text value is being recorded, 
Wathington said. 

"Most commercial testing 
tools provide a facility for 
record and playback, and typi- 
cally it's a fairly brittle imple- 
mentation," he said. "Record 
and playback is helpful for lots 
of reasons. It allows you to 
understand how to write your 
own tests or record a bug when 
you see it. So we wanted to 
offer record and playback in a 
Twist way." 

Twist allows testers to create 
DSLs (domain-specific lan- 
guages) for tests in order to 
record execution steps, 
Wathington said. The new fea- 
ture to record test assertions 
allows testers to verify if an 
action was completed or not. 

DETAILS ON CRUISE 

The latest version of Cruise 
provides the ability to include 
source control change numbers 
in build labels, as well as infor- 
mation on available disk space 
on build agents, which are sep- 
arate computers or virtual 
machines that can run builds. 
Wathington said it can more 
easily correlate builds with a 
specific source control version. 

Cruise is a server-agent 
model where one server parcels 
work to different build agents 
set up by the user. It consists of 
what ThoughtWorks Studios 
calls a zero-configuration grid, 
and the new version has 
expanded the grid so that up to 
100 agents can be utilized. 

"The agents are out there 
doing work, creating artifacts 
and generating files as part of a 
build," Wathington said. "In the 
new version, an agent will tell 
you if it's about to run out mem- 
ory through e-mail. 

"The main thing in Cruise is 
the performance improvements 
to make sure we can scale to a 
pretty large grid, and I think it's 
pretty exceptional for what's out 
there right now." I 
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DynaTrace 3.1 focuses on continuous integration 



BY DAVID WORTHINGTON 

A new version of dynaTrace 
Software's dynaTrace applica- 
tion performance management 
product is focused on enabling 
continuous integration through 
increased automation. 



dynaTrace 3.1, released in 
late September, is the product 
of a strategic decision to make 
dynaTrace as automated as pos- 
sible, said technology strategist 
Andreas Grabner. The objec- 
tive is to make dynaTrace better 



suited for inclusion in continu- 
ous integration and test man- 
agement environments. 

The dynaTrace server pro- 
vides external control through 
RESTful Web services and 
SOAP, Grabner said. The ser- 



vices can be used to extract data 
from reports that dynaTrace 
automatically generates, and 
pull that data into platforms 
such as Microsoft's Visual Stu- 
dio Team Foundation Server. 
"[Developers] can automati- 
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cally pull information out of 
dynaTrace and visualize the 
problems between build one 
and build two," Grabner 
explained. "It extends the pow- 
er of the unit test, regression 
analysis and complex architec- 
ture validations." 

Incident workflows have also 
been automated. The dynaTrace 
server can now send out alerts to 
those who need to see it, and the 
dynaTrace client will open to the 
incident when they log in, said 
Eric Senunas, senior director of 
marketing and communications 
at dynaTrace Software. 

dynaTrace is designed to run 
and collect data continuously. 
Version 3.1 can process 75% 
more measurements per second, 
and there is a 100% improve- 
ment in analyzing memory 
dumps, as well as a 30% reduc- 
tion in the size of its repository, 
the company says. 

Part of that performance 
increase is due to simplified sen- 
sor configuration. Wizards help 
developers "focus on what makes 
sense," and they make recom- 
mendations about what should 
be instrumented, said Senunas. 

Visibility was another focus 
area of the release. dynaTrace 
3.1 helps organizations under- 
stand what causes performance 
problems in virtualized envi- 
ronments by determining 
whether those problems were 
caused by an application or a 
virtual machine, Grabner said. 

The dynaTrace server pro- 
vides accurate timing for the 
VMware platform by imple- 
menting VMware s performance 
counters technology. Before- 
hand, instrumentation was not 
possible because VMware virtual 
machines would give inaccurate 
performance metrics, Grabner 
explained. "Virtual machines are 
scheduled to go off and on by the 
hypervisor...It could not catch 
up with the interrupts." 

The release also supports 
tracing applications that decou- 
ple services with an enterprise 
service bus (ESB); out-of-the- 
box support is provided for 
Oracles ESB. Other ESBs can 
be configured, but developers 
will have to do more work, 
Grabner noted. 

Lastly, there is a new SDK 
for creating monitors that trace 
transactions of custom proto- 
cols in Java and .NET "It adds 
transaction support across tiers 
that we don't support yet," 
Grabner said. I 
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Beck r Pugh to keynote ESDC 



BY ALAN ZEICHICK 

Famed agilist Kent Beck and 
expert author Ken Pugh are the 
featured keynote speakers at 
the Enterprise Software Devel- 
opment Conference, March 1- 
3, 2010, in San Mateo, Calif. 

Beck, an original signatory of 
the Agile Manifesto, is perhaps 
best known as the creator of 
eXtreme Programming, one of 
the most popular agile method- 
ologies. In addition, he's played 
a key role as an advocate of test- 
driven design and of software 
design patterns. Beck's talk, 
"Responsive Design: Efficiency 
Through Safety," builds on his 
latest work on software design. 

According to Beck, if you 
work on a program long enough, 
its design will need to change. 
One design strategy is to make 
design decisions early in hopes 
of not having to change them. 
The responsive designer, howev- 
er, focuses on making safe 
changes a little at a time. If you 
make small, safe changes fast 
enough, from the outside it 
looks like you are moving fast. 

ComponentOne 
introduces OLAP 
WinForms controls 

BY DAVID WORTHINGTON 

ComponentOne has introduced 
a suite of .NET Windows 
Forms controls that summarize 
data for business intelligence. 

The suite, called Compo- 
nentOne OLAP for WinForms, 
features chart, grid, panel and 
print document controls that 
are backed by an online analyti- 
cal processing (OLAP) engine. 
It was released in September. 

The standard edition of 
ComponentOne OLAP for 
WinForms costs US$1,800; it is 
also available with extended 
support services for $2,100. 

The suite's OLAP engine 
summarizes raw data according 
to criteria selected by the user. 
"Users can integrate Componen- 
tOne OLAP for WinForms into 
their user interface, making it 
compact and offering great cus- 
tomization," said Gustavo Eydel- 
steyn, managing director at 
ComponentOne . 

"Being able to transform raw 
data into visible patterns and 
trends without writing a single 
line of code offers significant 
time savings." I 



The open question, which Beck 
will discuss, is whether respon- 
sive design results in an overall 
loss or gain in efficiency, and 
under what conditions and time 
scales those changes take place. 



The keynote from Pugh — 
author of the award-winning 
book "Prefactoring" and of 
"Interface-Oriented Design" — is 
called "Snowboarding, Wind- 
surfing, Backpacking, and the 



Art of Software Development." 

In his address, Pugh will 
explore the lessons learned from 
experiences outside of software 
development and apply them to 
software development. For 



many sports, for instance, partic- 
ipants may already be using agile 
planning to create a winning 
strategy, as he will explain. 

The ESDC is a new event 
for IT professionals who 
design, code, build, deploy 
and manage software for their 
businesses. Learn more at 
www.go-esdc.com. I 
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Appian 6 bolsters reusability 



BY DAVID WORTHINGTON 

Appian s business process man- 
agement (BPM) application 
platform has been updated to 
give developers more opportu- 
nities to reuse components, and 
the company is building a com- 
munity to facilitate sharing 
among customers. 

Appian 6 became generally 
available in late September. It 
lends itself to reuse with appli- 
cation templates, process tem- 
plates, and shared components, 
said Samir Gulati, vice presi- 
dent of marketing. 

"Other BPM vendors have 
templates, but we have hotlinks 
within the product for develop- 
ers to browse the repository 
and download components that 
they think are useful to their 
own process application," he 
added. 

Developers can also create 
mashups and compositions 
using Google Web Toolkit, 
said Ben Farrell, director of 
corporate communications. It 
supports the Java Portlet 
Specification 1.0 and the Web 
Services for Remote Portlets 
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Appian can create a mashup that uses Google Maps and an RSS feed. 



specification. 

Another feature is the abili- 
ty for developers to see an 
application-centric view. In the 
past, developers could examine 
document processes, for exam- 
ple. They can now get more 
granular by seeing only the 
document processes that are 
relevant to an end user's appli- 
cation, Gulati said. 

In addition to the product 
update, Appian is launching 
new consulting services that 



provide customers with a 
framework for BPM program 
management, said Gulati. That 
involves training a staff, follow- 
ing a maturity model and creat- 
ing an internal center of excel- 
lence, he explained. 

The cost of Appian 6 varies 
from customer to customer. 
The company provides tools for 
customers to upgrade them- 
selves, but complex installations 
require professional services, 
Gulati said. I 



{Productivity mixes popular 
CRM apps with Protection 



BY JEFF FEINMAN 

Software protection and 
licensing company jProductiv- 
ity has added integration with 
well-known customer relation- 
ship management (CRM) 
applications to a new version 
of its Protection licensing 
security software. 

The new Protection Con- 
nect integrator in Protection 
4.5, released in September, 
lets users integrate their cur- 
rent Protection Enterprise 
platform setups with CRM 
applications, including Micro- 
soft Dynamics, NetSuite 
CRM + , Oracle CRM On 
Demand, Sage CRM and Sug- 
arCRM. 

j Productivity's Protection 
Enterprise automates licens- 
ing processes. It also lets 
developers add licensing to 
Web, enterprise, server and 
desktop applications. Alexan- 
der Krivov, CEO of j Produc- 
tivity, talked about how weak 
economic conditions can lead 
to software piracy becoming 



more of a problem. 

Most developers imple- 
ment one form of license 
when creating software, he 
said. Adaptable licensing soft- 
ware like Protection can help 
developers change the protec- 
tion of their software if their 
company's economic situation 
changes. 

"Developers using Protec- 
tion are able to build and dis- 
tribute their applications with 
the peace of mind that the 
unauthorized use of their 
applications is minimized, 
resulting in the recovery of 
potentially lost revenues," 
Krivov said. 

Protection 4.5 also has an 
improved ability to manage a 
server when it is running 
behind a firewall, and applica- 
tions run faster when licenses 
are managed over the Inter- 
net, according to the company. 
A new licensing assistant 
improves handling of HTTP 
proxy settings for requesting 
licenses. I 
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IBM's M2 crawls over 
data sets with Hadoop 
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BY JEFF FEINMAN 

With 1,386 members making 
up the two houses of the Parlia- 
ment of the United Kingdom, 
there is certainly no shortage of 
government data flowing from 
the territories of Great Britain 
and Northern Ireland. Bills 
must be voted upon, elections 
must be carried out, and many 
other actions must be tracked. 

That is one of the reasons 
why IBM created M2, an enter- 
prise data analysis platform. 
M2, announced in early Octo- 
ber at Hadoop World in New 
York, aims to help organizations 
better gather important govern- 
ment and business data. It was 
built using Apache Hadoop, an 
open-source Java framework 
that enables applications to 
work with large sets of data. 

M2 is IBM's latest Web 2.0 
technology, joining the ranks of 
the Mashup Center mashup 
platform and WebSphere 
sMash Web application devel- 
opment environment. 

Rod Smith, vice president of 
IBM's emerging technologies 
unit, said M2 is different from 
other data analyzers because it 
is flexible and able to scale to 
large data sets. It can also inte- 
grate with other visualization 
and analytic engines, such as 
IBM's Cognos business intelli- 
gence software. 

Smith said customers spoke 



about how they didn't know 
how to harvest vast amounts of 
data properly for business intel- 
ligence and analytics. "We 
scratched our heads about it for 
a while, and then when the 
Hadoop project got started up, 
it looked like a good foundation 
to build on where we could 
explore the idea of doing do-it- 
yourself analytics," he said. 

"It's about deeper intelli- 
gence that's more exploratory 
than what you'd think about 
from a data warehouse." 

In a demo with SD Times, 
IBM showed a BBC data 
mashup called "Digital Democ- 
racy," which sifts through gov- 
ernment-published data and 
makes that information easier to 
access for BBC journalists. The 
mashup can show which mem- 
bers of Parliament are working 
on what bills, as well as voting 
records, demographic trends 
and many other data points. 

M2 has a spider that crawls 
the Internet to retrieve content, 
but content can come from oth- 
er sources, such as internal data- 
bases. In the case of the "Digital 
Democracy" mashup, the spider 
collected a few million pages of 
content over four days, accord- 
ing to Stewart Nickolas, a distin- 
guished engineer for IBM's 
emerging technologies unit. For 
a crawl, a user will identify URLs 
he or she would like to begin 



with and how vast a search they 
want to conduct. 

Content is presented in a 
spreadsheet-like format. When 
information is brought back 
from a crawl, a user can analyze 
the data by saving it as a new col- 
lection and introduce a text 
extractor into the collection. An 
extractor can categorize informa- 
tion as people, places and things 
from an arbitrary piece of con- 
tent, Nickolas said. A filtering 
capability within the extractor 
allows the user to focus on infor- 
mation that is relevant to them. 

"We're pluggable up and 
down the stack from an archi- 
tecture perspective, so you can 
plug in many different text ana- 
lytics or extraction capabilities," 
Nickolas said. "You can create a 
flow of successive transforma- 
tions to very large sets of 
unstructured data." 

M2 uses Hadoop's Pig data 
analysis platform behind the 
scenes to run dataflow transfor- 
mations. There is a "combine" 
feature that can bring together 
information from different flows 
created by the user to link up 
categories from different lists. A 
pivot table can further group 
information into columns in 
order to show a specific data 
characteristic, such as how many 
times a Parliament member vot- 
ed "yes" on a bill, Nickolas said. 

Other features of M2 include 
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The "Digital Democracy" mashup created on M2 can sift through and 
categorize government data. 



a formula editor that can count 
up particular statistics on a table, 
as well as a bubble chart for dis- 
playing information. 

Data can be exported in for- 
mats such as CSV, JSON and 
RSS feeds. Nickolas noted that 
while some users might need to 
export terabytes worth of data, 
a key element of Hadoop is "to 
bring computation to data 



because it's so large." 

Smith said IBM will contin- 
ue to evolve M2 in order to fur- 
ther improve its data-harvesting 
capabilities. "We're getting 
closer to having this high-level, 
spreadsheet-like tooling so that 
domain experts don't have to 
send data off to external organi- 
zations or centralized [business 
intelligence] type of groups." I 



Veryant teaches COBOL new tricks 



BY DAVID worthington existing COBOL applications 

While many software makers with a new product that gener- 

are selling products to replace ates Web client interfaces. 

COBOL, Veryant is continuing Along with that, they are also 

its practice of modernizing releasing a driver that creates 
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isCOBOL Web Direct 2.0 generates COBOL code to sustain Web-based 
interfaces. 



relational databases without 
changing program data. 

isCOBOL Web Direct 2.0 
and isCOBOL SQL Server were 
added to Veryant's isCOBOL 
Application Platform Suite 
(APS) in September. APS 2009 
SP1 is available to licensed cus- 
tomers for no additional fee. 
Unlicensed customers would 
have to purchase it. 

isCOBOL Web Direct 2.0 
creates an AJAX interface for 
COBOL desktop applications 
that can be deployed in a brows- 
er. Developers use an Eclipse- 
based WYSIWYG editor to gen- 
erate code that is inserted into 
the procedure division of 
COBOL programs, said Alfredo 
Iglesias, vice president of busi- 
ness development at Veryant. 



APS does not add layers on 
top of old COBOL applications 
to make them look better, like 
"lipstick on a pig." It develops 
true COBOL applications, said 
Iglesias. "The [COBOL] devel- 
oper doesn't need to know 
AJAX or any other language or 
technique." 

The isCOBOL SQL Server 
product adds a relational data- 
base engine to COBOL ISAM 
(Indexed Sequential Access 
Method) files without changing 
program code or data. That 
eliminates the need to choose 
from maintaining ISAM files, 
modifying applications, or mov- 
ing to a relational database to 
"talk to the rest of the world," 
Iglesias said. 

It accomplishes that by 



using proprietary JDBC and 
ODBC drivers, creating a table 
data structure out of ISAM 
records, he explained. APS 
compiles standard COBOL into 
Java bytecode that executes in 
Java runtime environments. 

The Veryant relational data- 
base engine is also proprietary. 
"The functionality is compara- 
ble to any well-known database 
on the market," Iglesias said. 

An APS utility called SQL 
Explorer allows developers to 
create and manage databases 
and users; execute custom SQL 
statements; load, edit and run 
SQL scripts; view query execu- 
tion plans; and create and drop 
stored procedures, defined 
functions, and triggers. 

Database pricing is based on 
the APS COBOL runtime envi- 
ronment, with a charge of 
US$50 per concurrent user, 
Iglesias said. I 
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New alliance seeks to push 
universal mashup language 



< continued from page 1 

"We're not pushing a partic- 
ular proprietary platform, so 
the value to us is we're invest- 
ing in something that should be 
open and available to every- 
one," said Tim Hall, director of 
SOA products at HP software 
and solutions. "What we've 
seen over the last few months in 
our relationship with JackBe is 
customers wanting to put a face 
on their headless services." 

One of the issues in creating 
a mashup standard is coming 
up with a cookie-cutter method 
of banding together data from 
the enormous amount of 
sources on the Internet. David 
Abramson, director of product 
management for LogiXML, a 
creator business intelligence 
mashups, said he thinks it will 
be challenging to find a mashup 
standard because of all the dif- 
ferent ways data is used in 
mashups. 

"Mashups focus on bringing 
a bunch of different data 
together, and that could be 
everything from data in a data- 
base, custom Web services, or 
tools like Salesforce.com or 
RSS feeds, and bringing that 
data together is hardly some- 




The goal is to get the enterprise 
mashup market to grow more 
quickly, says JackBe's Crupi. 

thing that's gonna be easily 
standardized," Abramson said. 
"There's so many diverse tech- 
nologies out there, and every- 
thing's a little bit different, so 
creating a wrapper around all 
that could in some ways com- 
promise the performance of a 
mashup." 

However, Abramson said 
there are potential benefits to a 
mashup standard, such as the 
ability for companies that don't 
have much mashup experience 
to leverage the language. He 
also noted that mashups already 



utilize many standards, includ- 
ing HTML and JavaScript. 

DEPENDS ON CONTENT 

HP's Hall acknowledged that 
the amount of data sources for 
mashup creation does present a 
challenge to standardization. 
But he said HP's focus is on 
enterprise mashups, so that 
doesn't necessarily consist of 
mashing up every single service 
within an enterprise. 

"I'm sure [human resources] 
would have a bit of a panic 
attack if someone was mashing 
the LDAP directory with 
Google Maps so people could 
see where you lived. That's not 
a business purpose you want to 
enable," Hall said. "So you want 
to be able to put restrictions 
and controls around what 
sources of information and con- 
tent can be mashed." 

Membership in the Open 
Mashup Alliance is available to 
all organizations or individuals 
working with the technology. 
The EM ML specification, 
along with a runtime reference 
implementation, documenta- 
tion and sample code, are avail- 
able on the alliance website at 
www.openmashup.org. I 



FlightCaster gives 
glimpse at future 



< continued from page 1 

Cross. "Ultimately we want to 
be able to know what the FAA 
is going to do before they do it 
by understanding the factors 
that lead to that. That's where 
we're going. The next phase is 
going upstream from these 
things." He indicated that 
weather patterns and other 
information will be integrated 
into the site. 

FlightCaster is built on two 
stacks: the real-time stack that 
pushes data to users, and the 
research stack that is built on 
Hadoop, the Java software 
framework for data-intensive 
distributed applications, which 
actually performs the predictive 
analysis. 

The Hadoop stack is hosted 
inside Amazon's Web Services, 
said Cross, and therein lies one 
of the major problems the 
FlightCaster team encoun- 
tered. 

"The way [Amazon] S3 
works is that it expects clients to 
be actively reading and buffer- 
ing data to it. If you bring data 
into a Hadoop set, S3 says, This 
guy's not reading from me any- 
more, I'm going to close the 
connection.' We worked with 
Chris Wensel [creator of Cas- 



Spring 3.0 eases configuration for Java 



< continued from page 1 

which could be mixed and 
matched with internalized 
annotations inside the code. 

"Spring 3.0 adds a third 
choice: an externalized annota- 
tion-based configuration syn- 
tax. You have externalized in a 
Java syntax the kind of stuff 
you'd put in the XML configu- 
ration file. They can pick the 
best combination of XML, 
annotations inside the code 
they want to inject, or annota- 
tions in an externalized annota- 
tions file." 

The new Spring Expression 
Language can also be used to 
simplify the configuration 
process. The language, Sam- 
paleanu said, is somewhat sim- 
ilar to the Job Submission 
Description Language, but 
more powerful. He said that 
the new expression language 
can be used to describe tasks 
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Spring Framework 3.0 adds a new expression language, expanded 
support for REST, and time saving refinements for configuration. 



and configurations across 
Spring projects. 

Spring 3.0 is also the first 
version of the framework to ful- 
ly embrace Java 5. Sampaleanu 
said that Java 1.5 is the default 
baseline of capabilities support- 



ed in Spring 3.0. That means 
generics and annotations are 
finally supported throughout 
the framework. Annotations in 
particular are put to heavy use 
through the configuration 
changes for the framework. 



Keeping up with even newer 
Java versions, Spring 3.0 also 
adds first-class support for 
REST. Previous versions did 
support REST, but some edge 
cases were not possible to han- 
dle. Thus, in version 3.0, JAX- 
RS is fully supported, and ser- 
vices based on HTTP can be 
used throughout applications. 

Sampaleanu said that mov- 
ing to Spring 3.0 should be a 
relatively simple upgrade for 
existing Spring applications. 

"Just pull down Spring 3 and 
replace your jars. If you're 
using Maven or Ivy to pull 
down jars automatically, then 
it's a simple matter of pointing 
to version 3.0," he said. "You're 
going to just recompile your 
code, and you may get warn- 
ings and a few errors, but it 
shouldn't be difficult." 

Spring 3.0 is backward com- 
patible with previous versions. I 



cading, a Hadoop workflow 
API] on a solution," said Cross. 

"Ultimately, we ended up 
inserting a step that does a copy 
operation to copy all data across 
at once. You're more I/O bound 
than CPU bound, then, and 
we've never had any problems 
with anything being killed 
since." 

Cascading "helps to encap- 
sulate some of the plumbing for 
multistage map/reduce jobs in 
Hadoop," Cross said. "We work 
with a higher-level abstraction 
from Hadoop [thanks to Cas- 
cading]. The other benefit is 
the programming model. It 
lends itself pretty well to the 
kind of style we were building 
on top, which was doing distrib- 
uted computing as function 
composition." 

The research stack is 
topped off with the functional 
programming language, Clo- 
jure, which Cross had only 
dabbled in before coming to 
FlightCaster. 

"I liked it the best of the 
alternatives for doing more 
functional programming on the 
JVM. It's a natural fit for data 
processing and it has mecha- 
nisms for dealing with data 
structures. It's really a wonder- 
ful language," said Cross. 

For now, Cross and the 
FlightCaster team are focused 
on expanding the predictabili- 
ty of their system. They hope 
to spread the system so that 
they can make broad predic- 
tions rather than being 
restricted to predictions on a 
flight-by- flight basis. That will 
require other types of data to 
be analyzed, such as overall 
airport statuses, and weather 
reports and patterns. 

Cross said that, for him, the 
FlightCaster project changed 
how he looked at time when 
programming around it. "It's a 
different problem. I've done a 
lot with time, but nothing with 
discrete time. Usually it's a 
rolling window: markets are 
open or something," he said. 

"But here, we predict that 
this thing is going to occur at 
this discrete moment in time. 
It's interesting because you 
have this idea of your predic- 
tions rolling backward and for- 
ward in time relative to the 
departure." I 
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microsoft's upcoming Visual 
Studio Team System 2010 
release is anchored in effi- 
ciency and code quality, 
incorporating new ALM, architecture 
and testing tools. As the release draws 
nearer, the company is continuing to 
flesh out those features, and developers 
are learning how to adapt their work- 
flows to its new capabilities. 

Core improvements to Team Foun- 
dation Server (TFS) and making testing 
parallel to development are driving effi- 
ciencies across Visual Studio Team Sys- 
tem (VSTS), said senior product manag- 
er Doug Seven. Microsoft is also trying 



to ensure that "quality is paramount" 
throughout the software development 
life cycle, he added. 

TSF is the backbone of Microsoft's 
application life-cycle management 
(ALM) solution, Seven said. It is 
designed for collaborative software devel- 
opment, and facilitates that with artifact 
collection, project tracking, reporting and 
source control. 

Source control may yield the great- 
est gains in efficiency. The build server 
verifies code in isolation as it is 
checked into the TSF repository to 
make sure that it is not damaged in any 
way. "It's a huge thing to drive produc- 



tivity," Seven said, adding that build 
issues are a huge productivity drain to 
organizations large and small. 

However, team members may 
require training before an organization 
will realize the build process productiv- 
ity benefits. Microsoft moved the build 
system to Windows Workflow Founda- 
tion (WF), said Chris Menegay, a prin- 
cipal consultant for Notion Solutions 
and a Microsoft regional director (rec- 
ognized by Microsoft's Developer Plat- 
form evangelism group for technical 
expertise). 

"For those of us who never bothered 
to learn WF, we'll have to learn it," 



Menegay said. WF facilitates a lot of 
things, he said, such as customized 
workflows that have approval steps. 

TFS also includes work item 
improvements whereby tasks have par- 
ent-child relationships. "Those are 
rolled up into reports; it's huge in terms 
of visibility," said Seven. 

TIGHT WITH OFFICE, SHAREPOINT 

"The reporting is pretty cool in that it 
tightly integrates Office tools and Share- 
Point. Some of the best development 
managers I've ever worked with ran 
multi-million [lines of code] develop- 
continued on page 24 ► 
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ment projects off of Excel," said Jeffrey 
Hammond, principal analyst for applica- 
tion development at Forrester Research. 
"VSTS 2010 taps into that style of pro- 
ject management by turning spread- 
sheets into live documents, populated by 
data from TFS." 

Microsoft has also added Excel work- 
books that are tailored toward the agile 
community Those templates make it 
easier to automate practices such as 
reporting back for continuous integra- 
tion, daily stand-ups, and test-driven 
development, Hammond said. 

The prepackaged Excel reporting 
facilities reduce the amount of work that 
it takes to set up a closed management 
loop that is driven by metrics like burn- 
down charts, he noted. 

Changes made under the hood make 
it easier to scale applications across 
servers, and to back up and move pro- 
jects across servers, said Seven. 
Microsoft has used VSTS 2010 to help 
manage teams distributed throughout 
the world. "Millions of work items" and 
"hundreds of thousands of builds" of 
Microsoft software are being managed 
by the beta, he said. 

Build tagging, in particular, makes it 
simpler to write scripts, and it enables 
developers to reuse builds more pur- 
posefully, Menegay said. "VSTS 2008 
makes a team responsible for its own 
build machine. 2010 will make it more 
common to share build machines." 

TESTING FOR EFFICIENCY AND QUALITY 

Sharing is not just for machines; it's 
another way that VSTS enables devel- 
opers to work more efficiently. A new 
lab visualization tool enables testers to 
capture and record their environment 
to be packaged up and sent back to 
developers. 

The tool reduces "white space" 
between team members so that develop- 
ers and testers can work together more 

*/> PibHitfAinfcrnpg - rrtri^ici* irtsuil ^ifJid lilmntfirtipl 
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effectively to eliminate the "no repro 
scenario," said Seven. Without the tool, 
testers must reproduce bugs in their 
own environments, and not all bugs are 
easily reproducible. It also ensures that 
testers adhere to test cases. 

With lab visualization, "developers 
spin up the [virtual machine] for testing, 
test against it, and pass the snapshot 
back to the developer to debug," Mene- 
gay explained. "It reloads with the error 
message that the testers got on the 
screen." 

Another benefit is that developers 
and testers can work more closely during 
the course of a sprint, Hammond noted. 
"One outcome of a shift toward agile 
development is that it puts pressure on 
organizations that separate developers 
and QA professionals into separate cen- 
ters of excellence." 

Testing has also been moved to an 
earlier stage in the development life 
cycle, with new test planning tools to 
help organizations execute against plans 
and report back on the "progress of the 
tests themselves, not just the results," 
Seven said. 

Additionally, there are tools to cap- 
ture manual tests. "Previous releases 
had performance and load testing tools 
but no manual testing/black box testing 
tools," said Seven. A historical progres- 
sion of test completeness and require- 
ments fulfillment can help managers 
track the value of what is being delivered 
out of the development team, he added. 

"It is a step forward in test manage- 
ment; they have changed the process 
completely," said Menegay. "They have 
pushed testing to the front because the 
tools are available to the developers." 

He explained that it is the developer's 
job to run through pre-defined tests 
within the integrated testing tools. 
"Work cannot be called 'done' until they 
have run through the manual tests. By 
the time we have an automated build 
done, it's in pretty good shape." 
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Architecture Explorer provides modeling of workflows to help individual team members partici- 
pating in an agile process to track and trace work items. 
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VSTS' impact analysis interrogates and assigns test suites to source code before checking it in. 



While VSTS' testing feature set has 
been improved, it remains the buggiest 
area of the beta, Menegay cautioned. 
"I'm anxiously awaiting beta 2. Cus- 
tomers should not use the [unsupport- 
ed] testing tools in beta 1," he said. 

Seven would not confirm that a 
second beta would be distributed to 
testers. "We are aggressively working on 
finishing. How and when it's released 
will depend on when [the final product] 
is ready." 

ARCHITECTS SUCCESS 

Organizations may have a better idea of 
when their software is ready with VSTS' 
architectural tools, which provide 
requirements compliance, modeling and 
visual representations of source code. 

Microsoft's M, an XML-based mod- 
eling language, is incorporated into 
Visual Studio. M is a general-purpose 
language that is designed to help devel- 
opers integrate models across domains. 
M can translate domain-specific lan- 
guages such as BPEL, BPMN and UML 
to lower-level formats that runtimes 
understand. 

There are several use cases for mod- 
eling. Customers can model for the pur- 
pose of requirements and associate a 
diagram with work items, Seven said. 
Also, a diagram may be used as an extra 
artifact along with requirements to facil- 
itate the intent of what should be built. 
"It's part of bringing quality into the life 
cycle early on," he said. 

Modeling also helps communicate 
requirements to reduce bugs and pro- 
mote code understanding, he said. A 
modeling tool called Architecture 
Explorer parses over the codebase and 
generates visual representations of arti- 
facts, and how namespaces or assem- 
blies connect them. 



Aside from modeling, Architecture 
Explorer will deliver new source con- 
trol facilities, including branch visual- 
ization, which helps developers main- 
tain multiple releases of software in 
parallel. 

Microsoft will endeavor to help cus- 
tomers understand the value of the tools 
for architectural consistency and com- 
pliance through its MSDN website, Sev- 
en said. Additionally, enforcement rules 
may be created around architecture. 
"Unit testing does not mean that you've 
done it correctly," he said. 

The tools, he said, will enable reuse 
and maintainability in the long term. 

"As a one-time product manager for 
Rational Rose, I'm pleased with how the 
VSTS team has developed its modeling 
constructs; they feel very practical and 
focus on a pragmatic 'bottoms-up' 
approach," Forrester's Hammond said. 
"This will appeal to the same types of 
development teams that Rose did: teams 
that want to use models to reason about 
the systems they're building, but not 
necessarily go the whole Model Driven 
Architecture route." 

Menegay was not certain that 
Microsoft platform developers would 
use the tools, and he suggested that very 
few companies do modeling. "If the 
tools are in the box provided by 
Microsoft, maybe they will," he said. 

Many of the new architectural fea- 
tures in VSTS 2010 will not change any- 
one's life, but the testing tools will 
change the way companies do testing, 
Menegay added. 

"It's a huge release. VSTS 2008 was 
like 1.1 and was nothing that got people 
really excited. 2010 has lots of stuff in it. 
In an hour, you can just mention every- 
thing, but not talk in-depth," he con- 
cluded. I 
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FROM THE EDITORS 

Too early for mashup standards 

Premature standardization kills innovation. While the effort to pro- 
mote standards is certainly laudable, we believe that when a concept 
is in its infancy, an attempt to lock in an early set of protocols stifles cre- 
ativity This is certainly the case with the new Enterprise Mashup 
Markup Language, or EMML, proposed by a group of companies calling 
itself the Open Mashup Alliance. It's too soon to even begin thinking 
about calling it a standard. 

Mashups are a relatively new concept, at least in terms of broad 
deployment of services spanning SOAs and classic enterprise service 
buses, as well as cloud-based systems, Software-as-a-Service and Soft- 
ware-a-a-Platform. New usage models are appearing nearly every day. 
We are only in the beginning stages of realizing how to leverage mobile 
applications. Many mashups are experimental pilot projects; few are 
being using in any type of business-critical environment. It's hard to think 
of combining the words "mashup" and "scalable" in the same sentence. 

This is the perfect opportunity for experimentation. We view the 
EMML effort as one of many experiments that will be seen around 
mashups. While companies like JackBe (which created EMML) and its 
partners are doing good and important work, let's not be so quick to say 
"game over" and declare a winner. 

Perhaps SD Times is staffed by Luddites, but we remember an era 
when specifications were refined for years before seeking approval from 
standards bodies. Standards efforts weren't merely pushed by narrow 
vendor alliances, but also included participation by disinterested 
researchers as well as large customers. 

Mashups are new. We don't know where they're going, and neither 
does, we submit, the Open Mashup Alliance. Perhaps EMML is the best 
path toward creating a language for service invocation. Perhaps not. 
However, we feel that mashups need more time to evolve, and EMML 
needs time to adapt to where developers are taking mashups. 

When properly matured, standards provide a stable base for innova- 
tion and interoperability. When rushed to market for competitive 
advantage, standards constrain innovative thinking. At this point, we 
need lots of new ideas and many exciting initiatives around mashups. 
Not only is it too early to standardize EMML as the de facto markup 
language for describing mashups, it's too early to be even thinking 
about standardization. We urge the industry to slow down and to keep 
experimenting. 

A glimpse of the future 

From the outside, FlightCaster looks like any other software startup. 
But under the hood, everything is completely different. The compa- 
ny represents a peek at the future of software development: The stack is 
a predictive artificial intelligence system on top of Hadoop, with a JVM 
in the middle that runs Clojure. Oh, and the software runs in Amazon's 
EC2 cloud with an external Web server that hosts three different smart 
phone applications. 

That's a buzzword density that should make everyone on Slashdot 
quiver with excitement. 

It's easy to overlook how much software development is changing, 
thanks not only to cloud services, but also the latest agile methodologies 
and new frameworks for distributed computing and scalable storage. The 
world inhabited by FlightCaster is a far cry from the monolithic 
client/server applications of only a few years ago, or even the bulk of 
enterprise SOA applications being built today. Half the technologies that 
FlightCaster is using didn't even exist five years ago. 

We're not suggesting that you rip out your existing infrastructure in 
favor of the FlightCaster approach, but we do suggest you consider it as 
an example of a new development paradigm. The world of software 
development is changing, and it's changing faster than we could have 
imagined only a decade ago. I 



Old thinking does a disservice 
to new data hubs 



Larry Dubov 



Master Data Management (MDM) 
deals with master data. Master data 
are those that are generally the most 
highly shared and the most critical to 
successfully meeting the goals of an 
enterprise. Master data are the most 
essential sets of core data to an 
enterprise, which means they 
have to be accurate. If master 
data are inconsistent, they 
could potentially expose an 
enterprise to significant risk. 

Over the past decade, data 
hubs have become a popular 
and evolving architectural con- 
struct for MDM and other 
enterprise data management 
solutions. Yet in my travels, I'm 
amazed that so many IT professionals still 
aren't clear in their understanding of data 
hubs and their capabilities. The term is 
used (inaccurately) to mean the same 
thing as the more traditional operational 
data stores of the 1980s and 1990s. This is 
quite maddening because misusing the 
term adversely affects understanding 
modern design options of Enterprise 
Data Management (EDM) and MDM 
solutions that are enabled by data hubs. 

There are some key characteristics 
and features of data hubs that often are 
underestimated or misunderstood by 
enterprise architects and systems inte- 
grators. Here are two of the most com- 
mon misconceptions: 

Misconception 1: Data must be 
cleansed and standardized before it is 
loaded into the data hub. 

For many professionals brought up on 
the concepts of operational data stores, 
data warehouses and ETL (extract, trans- 
fer and load), this is an undisputable 
truth. Data must be first cleansed before 
the inbound processes load the data in 
the hub. With this principle in mind, a 
data hub is just another data repository or 
database used for storage of cleansed 
data content, oftentimes used to build 
data warehousing dimensions. 

The reality nowadays for data hubs 
includes a much more active approach 
to data than just storage of a golden 
record. The data hub makes the best 
decisions on entity and relationship res- 
olution by arbitrating the content of data 
created or modified in the source sys- 
tems. Expressed differently, a data hub 
operates as a "service" responsible for 
the creation and maintenance of master 
entities and relationships. 

The data hub as the enterprise Mas- 
ter Data Service (MDS) applies the pow- 
er of advanced algorithms and human 
input to resolve entities and relationships 
in real time. In addition, data governance 
policies and data stewardship rules and 
procedures define and mandate the 




behavior of MDS, including the release 
of reference codes and code translation 
semantics for enterprise use. 

The data hub as MDS provides an ide- 
al way for managing data within a SOA 
environment. Using a hub-and-spoke 
model, the MDS serves as the 
integration method to com- 
municate between all systems 
that produce or consume 
master data. The MDS is the 
hub, and all systems commu- 
nicate directly with it using 
SOA principles. 

Participating systems are 
autonomous in SOA par- 
lance, meaning that they can 
stay independent of one 
another and do not have to know the 
details of how other systems manage 
master data. This allows disparate sys- 
tem-specific schemas and internal busi- 
ness rules to be hidden, which greatly 
reduces tight coupling and the overall 
brittleness of the ecosystem. It also 
helps to reduce the overall workload that 
participating systems must bear to man- 
age master data. 

Misconception 2: The golden record 
must be persisted in the data hub. 

The notion of a data hub as a data 
repository presumes that the golden 
record must be persisted in the data 
hub. The notion of the data hub as a ser- 
vice does not make this presumption. 
Indeed, as soon as the master data ser- 
vice can deliver the golden record to the 
enterprise, the data hub may or may not 
persist the golden record. The notion of 
the data hub as a service leaves open the 
decision to persist or not to persist. A 
data hub can persist the golden record 
or assemble it dynamically instead. 

One of the arguments for a persis- 
tently stored golden record is that per- 
formance for golden record retrieval will 
suffer if the record is assembled dynam- 
ically on request. The reality is that the 
existing data hub solutions have demon- 
strated that a dynamic golden record can 
be assembled with practically no perfor- 
mance impact. 

One of the advantages of dynamically 
assembled records is that the data hub 
can maintain multiple views of a golden 
record aligned with line-of-business and 
functional requirements, data visibility 
requirements, tolerance to false posi- 
tives and negatives, and latency require- 
ments. Mature enterprises increasingly 
require multiple views for the golden 
record, and the dynamic record assem- 
bly works better to support this need. 

Another argument oftentimes brought 
up in favor of a persistently stored golden 
record comes from the need to support 
the history of the golden record. Indeed, 
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history support for master data is critical. 
There exist two major usage patterns for 
the history of master data. 

The first pattern is driven by audit 
requirements. The enterprise needs to be 
able to understand the origin, the time 
and possibly the reason for a change. 
These audit needs must be supported by 
the data hub at the attribute level. MDM 
solutions that maintain the golden record 
dynamically address this need by sup- 
porting the history of changes in the 
source systems record content. 

The second usage pattern for history 
support results from the need to support 
database queries on data referring to a 
certain point in time or certain time 
range, such as what was the inventory on 
a certain date, or sales over the second 
quarter. A classic example of this type of 
history support is the management of 
slowly changing dimensions in data ware- 
housing. In order to support this usage 
pattern, the golden version of the master 
record must be persisted. It is just a ques- 
tion of location. Many enterprises decide 
this question in favor of data warehousing 
dimensions while avoiding the persistent- 
ly stored golden record in the data hub. 

Modern data hubs function as active 
components of service-oriented archi- 
tecture and master data services, rather 
than passive repositories of cleansed 
data. This consideration should help the 
enterprise architects and systems inte- 
grators build sound master data manage- 
ment solutions. I 

Larry Dubov is senior director of busi- 
ness management consulting at Initiate 
Systems, and is co-author of "Master 
Data Management and Customer Data 
Integration for a Global Enterprise," 
McGraw-Hill, 2007. 



Billable hours, 
not billable bits 



Where's the money in the software 
business? Increasingly, it's in the 
consulting or maintenance contracts or 
in software rental — anything but in the 
software itself. 

Consulting around enterprise soft- 
ware isn't new. One of the 
tenets of the open-source 
software movement is that 
software itself should be free, 
and that customers should pay 
for support. If you don't need 
help with the software, great. 
If you do need help, well, you 
can sign up for service con- 
tracts, buy a maintenance 
agreement or engage some- 
one to help you on an hourly 
basis. 

That's obviously the case with the 
Big Software Companies, as well. 
When IBM purchased Lotus Develop- 
ment Corp. in 1995, Big Blue knew 
that the Notes' software licenses were 
only part of the prize. The bigger 
benefit was that Notes customers 
would need lots of handholding from 
IBM Global Services. And indeed, 
Notes has been a cash cow for IBM 
ever since. 

Where IBM has Global Services, 
Hewlett-Packard has EDS. HP has 
expanded its services business tremen- 
dously since that purchase a year ago, 
to the point where, in September, HP 
decided to abandon the EDS brand. 
Now, customers will work with HP 



Zeichick's Take 




Enterprise Services. 

Dell, too, is getting into the services 
game in a big way, with its announced 
acquisition of Perot Systems. In Dell's 
case, though, the big payoff would be 
in increasing its enterprise hardware 
sales; Dell is not a big fish in 
the bits business. 

Of course, betting your 
business on selling billable 
hours instead of billable bits 
doesn't always pay off. Sun 
Microsystems moved aggres- 
sively into open-source soft- 
ware, giving away nearly all 
of its crown jewels in the 
hope that customers would 
sign up for service contracts. 
Sun also spent US$1 billion buying 
MySQL in early 2008, betting big that 
it could make lots of money on services 
by giving away even more software. 
That didn't work out, and of course, 
Sun is now in the process of being 
acquired by Oracle. 

As companies like Microsoft look to 
move big-profit software businesses 
like Office to the Cloud, renting soft- 
ware by the hour seems to be the next 
model. Has the era of selling a software 
license passed us by? What do you 
think? 

Alan Zeichick is editorial director of SD 
Times. Follow him on Twitter at twit- 
ter, com/zeichick. Read his blog at 
ztrek. blogspot. com. 



Technology sector recovery to outpace 
U.S. economy's recovery 



DATA WATCH 



Software executives believe the technology industry will be a key factor in leading the United 
States' economic recovery, with eight out of 10 executives expecting business conditions in the 
technology sector to improve in 2010, according to figures from tax and advisory firm KPMG. 
One hundred and thirty software and hardware executives were surveyed. 



43% 

expect the U.S. economy 

to recover after 2010 










77% 

expect the technology sector's recovery 
to outpace the U.S. recovery 



39% 

expect the U.S. economy 

will recover in 2010 




80% 

expect business conditions in the 
technology sector to improve in 2010 



Source: KPMG 
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The Hitchhiker's Guide to the Economy 



Don't Panic. Sure, right now things are 
unpleasantly like being drunk 
("What's so unpleasant about being 
drunk?" "You ask a glass of water"), but it 
looks like we've dodged the feared eco- 
nomic apocalypse. The ironically good 
news is that the software development 
industry faced its brutal introduction to 
the 21st century already, when it was our 
own industry that frothed over. Wages 
deteriorated, jobs migrated overseas, and 
complacency about skills and opportuni- 
ties was replaced by a focus on quality and 
productivity. Right? 

Although traditionally the steeper the 
economic drop, the steeper the recovery, 
most economists say that this recession 
will have an "L-" or "U-" shaped recovery, 
since so much household wealth has been 
lost. On the other hand, business technol- 
ogy has already languished for most of the 
past decade, and there seems to be a good 
deal of pressure from a "shadow invento- 
ry" of undeveloped applications. Windows 
7 looks ready to deliver the upgrade cycle 
that Vista promised, and mobile applica- 
tions have finally taken off as targets for 
mainstream development. 

NEITHER A BORROWER NOR LENDER BE 

As a contractor, I typically ask for a 
retainer when I first begin working with 
a customer, but I've always applied the 



retainer against the initial work and, 
over time, simply billed at the end of the 
month. This follows from my natural 
empathy to the customer's viewpoint 
that a retainer that is just sitting in a 
bank account amounts to, at best, an 
interest-free loan and, at worst, has a 
taint of being money paid for non-exis- 
tent work. 

The natural consequence 
of "bill as you go" is that as a 
contractor, you're extending 
credit to your customer. If, 
like me, you bill once a 
month, don't expect to 
receive the payment for two 
weeks and then try to work 
things out before stopping 
work. You've got two months 
of your own time hanging out 
there. Even worse, if you pay subcon- 
tractors and pass through their billing, 
you might have as much as 10 weeks of 
obligations that are reliant on the good 
faith of your client. 

A not entirely shocking lesson of 
business is that people's "good faith" 
operates strictly through a lens of their 
own self-interest. This summer, follow- 
ing a human tragedy (the death of the 
project manager), the president of a 
client company stepped in, realized 
that there was no way to launch soon, 



freaked out, and declared that my com- 
pany had been "paid enough" for the 
work we'd delivered. I said that if our 
conversation ended without him com- 
mitting to paying what he owed, I'd be 
telling my developers that afternoon to 
stop work. We both felt that the other 
was suddenly acting in bad faith. 

Merits aside, I made a 
business mistake. A lone 
developer risks "only" his or 
her own time. A large com- 
pany can amortize the risk of 
occurrence and cost of 
recovery from a deadbeat 
I client. A small company, in 
^fY hard economic times, has to 

manage their balance sheet 
better than I did, even if it 
means making the initial 
negotiation of contract terms a little 
more difficult. 

UPGRADE YOUR BITS 

As a software developer, your job is 
simple: rapid development of business 
value. You need a brain, a computer 
and development tools. Brains are 
evenly distributed and fast computers 
are commodities. It's in the tool suite 
where those in the first world maintain 
an edge over those in developing 
economies. 




Take, for instance, MonoTouch, Nov- 
ell's recently released tool for program- 
ming the iPhone with C# and .NET. It 
costs US$400 on top of the normal 
iPhone development requirements: the 
purchase of an iPhone and a Mac. That 
may be a prohibitive set of costs for 
those living outside of North America or 
Europe. But for those with .NET back- 
grounds, the freedom to choose 
between C# and Objective C as a devel- 
opment language is of great value. If 
MonoTouch allows you to make a pre- 
sentation prototype, it might mean the 
difference between a project going for- 
ward or not. (Whether the benefits of 
C# justify a MonoTouch dependency in 
a deployed application is something I'll 
discuss in a forthcoming column.) 

KEEP YOUR JOB 

Perhaps surprisingly, even in this econo- 
my, wages are increasing for those with 
jobs. Unemployment is at a multi-decade 
high, but most employed people have 
received a raise in the past year. This is in 
accordance with the "sticky wage" eco- 
nomic theory, which holds that even with 
decreased labor demand, companies will 
hesitate to lower pay, fearing unmotivated 
and disgruntled employees. 

So, keep your chin up. The economy is 
bad, but it's not as bad as Vogon poetry. I 

Larry O'Brien is a technology consul- 
tant, analyst and writer. Read his hlog at 
www. knowing, net. 



From open source to commercial quality 



For the last year, our company has 
been working with a client that is 
moving from a purely open-source mod- 
el to a commercial product. The OSS 
product is already widely used, so the 
first year has consisted of setting up the 
corporate entity, creating the support 
infrastructure, and building a sales team 
while closing deals with users who were 
eager to get a commercial license and/or 
priority tech support. Next year, working 
from an established base of customers 
will see a stronger push for sales at sites 
not familiar with the product. 

The model is slightly unusual: a self- 
funded OSS company is a rara avis. As a 
result, there are no case studies to build 
on, and much of the details of this partic- 
ular model have to be learned on the run. 

One particularly interesting set of 
changes occurs in product development 
and management as the transition from 
OSS to commercial quality is undertak- 
en. Some readers, especially OSS 
diehards, will view this as a false 
dichotomy. Nothing in the OSS model 
should imply software of less than com- 
mercial quality. At least, not in theory. 

This particular project consists of 
roughly half a million lines of code that 
were written primarily to solve a specific 
set of problems. The developers had cer- 



tain business needs, wrote a solution, and 
shared it as OSS. They also wrote more 
than 600 pages of documentation. How- 
ever, they did not design the product to 
compete with commercial offerings. Over 
the years, other contributors added pieces 
here and there to solve other specific 
problems: generally, just enough code to 
obtain a specific feature. 

As a result, one of the first 
things we've done with the 
product is to decide what fea- 
tures to remove. What features 
are partially implemented with 
no likelihood of completion? 
What features add nothing to 
the value proposition of the 
product? What features that 
are not central are more trou- 
ble than they're worth? All of 
these features are being removed and put 
into a separate OSS resource pool that 
users can adopt, while keeping those bits 
out of the commercial offering. 

We've also changed the release 
schedule. Prior to commercialization, 
the core team put out new releases four 
to six times a year. They believe in the 
agile creed of frequent small releases. 

However nice this practice is for 
internal product development, it is 
anathema to enterprise customers and 



Integration Watch 




ISVs. They want no more than two 
releases a year. And they're not terribly 
happy about patches to those releases. 
Having fewer releases makes it easier to 
sell against future features, and the 
longer planning cycle enables true prod- 
uct management, rather than "whatever 
is next needed," which is characteristic 
of OSS projects written pri- 
marily for the needs of the 
contributors. 

Predictably, quality require- 
ments have increased as well. 
Previously, the development 
process was at Capability 
Maturity Model (CMM) level 
2: repeatable, but not defined, 
managed or optimized. This 
has been one of the more 
challenging changes. Devel- 
opers who have maintained their quality 
standards at a given acceptable level of 
quality are not easily convinced of the 
need to tighten quality control — especial- 
ly as this requires more effort. 

To a certain extent, new tools — made 
possible by the ingress of funds — can be 
of help in the process. For these purpos- 
es, we've been examining Atlassian Stu- 
dio, which provides hosted versions of 
Subversion, JIRA, Confluence (a wiki), 
FishEye (SCM analysis), and Crucible 



(peer code reviews) for $25 per develop- 
er per month. This solution appears to 
be tailor-made for small, distributed 
teams like ours. 

The last major change is the nature of 
support. Hitherto it has consisted of 
posting answers to the mailing list. This 
has worked fine within the confines of 
normally accepted protocols for asking 
for help online. With paid tech support, 
however, all questions must be answered 
quickly, and ignoring stupid or rude 
questions is not an option. Moreover, 
customers expect something more than 
a mailing list — generally a private portal 
of some kind. Support is one of the areas 
where the value of a paid license can be 
made especially conspicuous, so its 
proper implementation is, and should 
be, a high priority. 

Interestingly, all these changes are 
for the better and all, without exception, 
rest on one aspect: introducing greater 
rigor. This rigor is the quality often miss- 
ing from OSS projects, in part because 
it's difficult to impose it on contributors 
who are donating their time. But OSS 
projects that want to stand out from the 
crowd or are entertaining thoughts of 
eventually going commercial can help 
themselves significantly by establishing a 
pattern of this rigor early on. I 

Andrew Binstock is the principal analyst 
at Pacific Data Works. Read his hlog at 
binstock. hlogspot. com. 
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RESEARCHERS AT MICROSOFT'S 

Cambridge, U.K. labs have been working 
on a multi-kernel operating system called 
"Barrelfish." This is noteworthy because 
Barrelfish includes some BSD-licensed 
open-source libraries, and Microsoft has 
made a test version available. 

After I covered Microsoft's "Midori" 
project last year, I was told that there 
were several other projects that deal 
with parallelism. The difference is that 
Midori stands apart, because it was 
moved beyond research and put under 
the control of a top company executive. 
It will be interesting to see what 
Microsoft ultimately does with its com- 
mercial software. 

— David Worthington 

I RECENTLY WROTE ABOUT a com 

pany called Coveros, an application 
security consulting company. I chatted 
with Coveros CEO and cofounder Jef- 
frey Payne, who had been CEO and 
president of Cigital, another application 
security provider. In talking about some 
of the differences between the two com- 
panies, Payne said that this time around, 
the emphasis is more on trying to help 
companies avoid security issues before 
they ever happen. 

"At Cigital, the business was bug- 
finding, so we were really good at assess- 
ing applications and looking for defects 
and issues," he said. "It definitely did 
and still does some process improve- 
ment-type things around trying to make 
sure you don't make those issues. Ulti- 
mately, though, it's just a business about 
finding problems." 

Coveros, meanwhile, tries to help 



people "not have security problems in 
the future," Payne said. 

— Jeff Feinman 

ONE OF MY FRIENDS, to whom I will 
refer as the Doctor, has been spending 
all of his work time recently in Ant hell. 
Normally, he is a sys admin, but when 
the company he works for finally got its 
Java processes in order (by hiring a QA 
guy and a full-time Java developer or 
two), the Doctor was saddled with the 
build process. 

I feel exceptionally bad for the Doc- 
tor. This is not what he wants to spend 
his time doing. It 
takes forever, and he 
is constantly being 
yelled at for not get- 
ting as much done 
with the build as he 
used to get done in 
the data center when 
a machine died. Adding insult to injury, 
he is not allowed to bring in new Java 
tools like Maven or Ivy, as those are 
developer tools, and he's a sys admin. 
How could a lowly sys admin possibly 
attempt to choose tools for the dev team? 

It gets worse: When the Doctor went 
on vacation, he was chided for not doc- 
umenting the build process well enough 
for his coworkers to fill in for him while 
he was gone. I personally feel that noth- 
ing he could have written would have 
made Ant easier to deal with. There's no 
real point to this story, other than a sim- 
ple plea for the lost souls out there that 
belong to other admins in the Doctor's 
position. It's a sad state of affairs when 
developers steal an admin away to do 




the tasks they themselves don't want. 

— Alex Handy 

INRULE TECHNOLOGY IS ALL 
ABOUT .NET When I spoke with com- 
pany CEO Paul Hessinger in May for 
the launch of InRule's 3.2 business rules 
engine and management software, he 
said that "the .NET factor is a key 
dynamic for us." So next week, at 
Microsoft's Midwest district offices in 
Downers Grove, 111., the company will 
explain how to leverage its business rules 
engine technology in Microsoft tech- 
nologies such as BizTalk Server, Win- 
dows Workflow Foundation and Win- 
dows Communication Foundation. 

Rule authoring and application inte- 
gration will be demonstrated. Business 
rule technology gives organizations the 
ability to change how their applications 
handle information based on a new set 
of parameters (e.g., "For the next three 
hours, all customers get a 10% discount 
on purchases.") without changing the 
underlying code. This is best accom- 
plished, Hessinger said, when rules are 
not hard-coded into an application, giv- 
ing greater flexibility to the organization. 

One point that Hessinger made sure 
to address is the common argument that 
rules engines don't perform well. "Per- 
formance is an omnipresent issue for us. 
Our performance race will never be 
over. We're like 'Forrest Gump' . . . 'run 
Forrest, run!'" 

So, if you're in the Downers Grove 
neighborhood on Oct. 20 at 6 p.m. Cen- 
tral Time, you might want to run over 
there and check it all out. 

— David Rubinstein 



BUSINESS BRIEFS 



Hewlett-Packard has changed the name of EDS, the business 
process outsourcing company it acquired last year for US$13.9 bil- 
lion, to HP Enterprise Services. HP will also close a Lansing, Mich, 
call center that it had acquired in the EDS takeover. According to 
HP, no jobs will be cut, and the approximately 200 workers at the 
facility will have the option to commute to another Michigan-based 
facility . . . Microsoft has acquired two enterprise resource plan- 
ning (ERP) products that company executives said will strengthen 
its Microsoft Dynamics AX ERP software. Microsoft acquired a 
business process integrator from Fullscope, a company that cus- 
tomizes Dynamics AX for mid-market companies. Microsoft also 
brought in software for professional services from Computer Gen- 
erated Solutions, a business software and service company. All 
products will be offered as part of Microsoft Dynamics AX, accord- 
ing to the company. 

EARNINGS: BMC Software reported first-quarter fiscal 2010 rev- 
enue of US$450 million, an increase of 3% from the year-ago peri- 
od. Net earnings for the quarter were $82 million versus $1 million 
year-over-year. The company said that first-quarter net earnings 
for fiscal 2009 were impacted by a $50 million in-process research 
and development write-down recorded in connection with the 
acquisition of BladeLogic in March 2008. License revenue in the 



first quarter was $167 million, an increase of 12% compared to the 
first quarter of fiscal 2009 . . . Mobile device software and prod- 
uct provider Intrinsyc Software announced second-quarter 2009 
revenue of US$4.9 million, as compared to $4.4 million in the first 
quarter of this year and $5.6 million in the second quarter of 2008. 
Total revenue attributable to the company's software products was 
43% of revenue, including software licensing and software-related 
services, compared to 23% on a year-over-year basis . . . Black- 
Berry creator Research In Motion reported that revenue for the 
second quarter of fiscal 2010 was US$3.53 billion, up 3% from 
$3.42 billion in the previous quarter and up 37% from $2.58 billion 
in the same quarter of last year. The revenue breakdown for the 
quarter was approximately 81% for devices, 14% for services, 2% 
for software and 3% for other sources. Net income for the quarter 
was $475.6 million, compared with net income of $643 million in 
the prior quarter and net income of $495.5 million in the same 
quarter last year . . . TIBCO Software saw a decline in revenue to 
US$150.3 million in the third quarter of fiscal 2009, a drop from 
$162.3 million in the same quarter a year before. Net income for 
the quarter was $14.9 million, an increase from $11.1 million in the 
same period last year. Non-GAAP operating income was $32.5 mil- 
lion for the third quarter, compared to $28.7 million on a year-over- 
year basis. I 



EVENTS CALENDAR 



Zend/PHP Conf. 

San Jose 

ZEND TECHNOLOGIES 

www.zendcon.com 



Oct. 19-22 



Microsoft SharePoint Conf. Oct. 19-22 

Las Vegas 
MICROSOFT 

www.mssharepointconference.com 



Software Test 

& Performance Conf. 

Cambridge, Mass. 

STP COLLABORATIVE MEDIA 

www.stpcon.com 



Oct. 19-23 



Web 2.0 Summit 

San Francisco 
O'REILLY MEDIA 

www.web2summit.com/web2009 



Oct. 20-22 



ARM TechCon3 

Santa Clara 
RTC GROUP 

www.armtechcon3.com/2009 



Oct. 21-23 



SD2.0 China 

Beijing 
CSDN 

sd2china.csdn.net/en 



Oct. 22-24 



OOPSLA 

Orlando 
ACM SIGPLAN 

www.oopsla.org/oopsla2009 



Oct. 25-29 



Cloud Computing Expo 

Santa Clara 
SYS-C0N 

www.cloudcomputingexpo.com 



Nov. 2-4 



Visualization Conf. & Expo Nov. 2-4 

Santa Clara 
SYS-C0N 

www.virtualizationconference.com 

PASS Community Summit Nov. 2-5 

Seattle 
PASS 

summit2009.sglpass.org 

ApacheCon Nov. 2-6 

Oakland 

APACHE SOFTWARE FOUNDATION 

www.us.apachecon.com/c/acus2009 



Business of Software 

San Francisco 

FOG CREEK AND REDGATE 

www.businessofsoftware.org 



Nov. 9-11 



DevConnections 

Las Vegas 
DEVCONNECTIONS 

www.devconnections.com 



Nov. 9-12 



IDevDay 

Detroit 

DETROIT JAVA USER GROUP 

sites.google.com/site/1devday 



Nov. 14 



SPTechCon 2010 

San Francisco 
BZ MEDIA 

www.sptechcon.com 



Feb. 10-12 



Enterprise Software 
Development Conf. 

San Mateo, Calif. 
BZ MEDIA 

www.go-esdc.com 



March 1-3 



For a more complete calendar of U.S. software 
development events, see www.sdtimes.com/calendar. 
Information is subject to change. Send news about 
upcoming events to events@bzmedia.com. 
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CRYSTAL REPORTS® 
IT JUST WORKS 



A LEADER IN REPORTING 





THAT WORKS 



with Java or .NET, access virtually any 

database, and publish to the Web with support for Firefox, 
Safari, and Internet Explorer. 



WITH THE LATEST INNOVATIONS 



ips, manage 

dashboards and reports on a single server, and share 
interactive reports affordably via new licensing options. 



TEST DRIVE IT TODAY: 



;rystalreports/dev 
or contact us at 1-888-333-6007. 
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Visual Studio 






1996 to 2008 



i/Dundas 

gr Data Visualization 





Flexible data and KPI handling 
Intuitive drag-and-drop designer 
Robust dashboard viewing 
Simple integration and customization 
The latest Silverlight 3.0 technology 




ashDoard 




For more information please visit 

www.dundas.com/dashboard 

(41 6) 467-51 00 (800) 463-1 492 



